﻿ METODOLOGIE CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE ALEXANDRA GHEONDEA-ELADI n this paper a general view over literature reviews is given, as well as a short description of the possibilities of two of the current I bibliographical referencing softwares available, EndNote and Mendeley. I argue that unlike other types of literature reviews, a critical literature review cannot be undertaken by writing notes and using the search engines of bibliographical referencing softwares, but by focusing on a judgment structure which evaluates the theoretical background of the papers, their assumptions and one that provides a logical structure of the paper. Such a judgment structure is likely to be used across many fields in the social sciences. The proposed judgment structure has been provided based on its applications in two different fields from the social sciences. Keywords: literature review, critical thinking, judgment structure. There are several ways to conduct a literature review. Russell (1988: 127) describes three ways to proceed: “asking people, reading review articles and scouring the literature through use of bibliographic search tools”. As far as I have been able to see, the way in which researchers handle the amount of information is usually different from researcher to researcher. Some scholars extensively read various papers written on a chosen topic and, after a certain point, begin to structure the texts according to the trends in the literature or the scope of their research. Others, read extensively on the topic and choose several articles and books, considered to be the most important articles from the chosen pool of literature and focus on the way these articles have addressed the topic. Another possibility is to take notes from every article read, to make draft reviews in parallel with further reading and then to construct the structure of the information at hand by polishing and interpreting the notes. The last one, is perhaps the oldest of them all, since this was the only possibility a scholar had, when bibliography management software did not exist and making copies of a book was not technically available for everyone. Once mass copying became possible, scholars started to use post-its and notes on hands- on copies of the texts they read, in combination with indexing reading notes from texts which could not be copied. But managing vast amounts of information in such Adresa de contact a autorului: Alexandra Gheondea-Eladi, Institutul de Cercetare a Calitătii Vietii al Academiei Române, Calea 13 Septembrie, nr. 13, sector 5, 050711, Bucureşti, România, e-mail: alexandra.gheondea@googlemail.com. CALITATEA VIEłII, XXVI, nr. 2, 2015, p. 167–190 1ALEXANDRA68 GHEONDEA-ELADI 2 a way can be difficult, since it all resumes to the researcher’s capacity to ‘keep in mind’ at a certain moment in time a large amount of literature. When computer-based reference management software were created and available freely for everybody the manual indexing system was transposed into an electronic indexing system of bibliographical references. With programs, such as Mendeley, RefWorks, EndNote, Zotero and others, the researcher is no longer required to keep in mind indexes and codes and devise an efficient way to find them within stacks of folders. Nevertheless, the literature review process goes beyond the simple indexing of text and merging indexes in a coherent story. It is about understanding the logic and meaning of scholarly publications. This perspective is based on the idea that literature reviews can be biased if performed in a way that is not structured and replicable. This is why the main rationale for undertaking structured and replicable literature reviews is to avoid cherry picking and biases that might lead researchers to consider as mainstream points of view which are only marginal in the literature. The dangers of such biased literature reviews is more obvious in medical research in which meta-analyses are employed to argue for or against the use of a certain drug or treatment. If such a review would be in any way biased, the dangers for those in need of treatment may be devastating. Similarly, in social policy, providing biased literature-based evidence that a certain group is vulnerable and should be included for social aid, for example, may lead to excluding another important vulnerable group from the benefits of social aid. In this article I propose a structure for critically evaluating literature on a given topic and argue that such a structure cannot be undertaken by using only bibliographical referencing software’s facilities for notes or their automatic indexing and search engines. WHAT IS A LITERATURE REVIEW? Most scholars perform literature reviews as part of any scientific endeavour. More than this, a literature review is in itself a research endeavour with its own methodologies and specific inquiry styles. In performing a literature review it is important to know how to obtain relevant, accurate and as complete as possible information about the topic being researched. Literature review is above all a process by which a researcher surveys the literature available in a field of study at a certain point in time. The goal of a literature review is to provide a structured perspective over the current knowledge in a certain domain at a certain point in time. This means that, on top of a general or more specific understanding of science, there should be a basic understanding of how scientific literature is stored and where it can be found (Russell, 1988). Around the world, there are various journal data-bases, like Scopus, EBSCO, Wiley, Blackwell, Sage and so on. The process by which literature review should be performed is well-documented in most social research manuals (Bryman, 2008). It is mainly comprised of two steps: searching 3 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 169 and analysing literature. The key to an effective and efficient literature search is structure and replicablility. Bryman (2008) differentiates between a narrative review which is an exploratory endeavour aimed at understanding a new field of research and discovering its main concepts and ideas and a structured review which is a process in which the researcher investigates a field of study in a systematic and transparent manner in order to avoid biases that might lead to false conclusions about current knowledge in the field of study. BIBLIOGRAPHICAL REFERENCING SOFTWARE There is a wide variety of bibliographical referencing software available nowadays online, like Mendeley, RefWorks, EndNote and so on. These are programs that have several facilities in common: they store bibliographical references with or without source files, they are able to generate bibliographical references in most of the accepted formats, like American Psychological Association (APA), Harvard (in its many forms), and also are able to perform automatic indexing for efficient searches. In order to understand better the difference between bibliographical referencing software, I will compare the use of two such software: Mendeley 1.13.4 (developed by Mendeley Ltd., freely available on the web) and EndNote 8 (developed by Thompson Reuters, available upon paid subscription). A detailed review of these software is beyond the scope of this paper. The comparison that will be undertaken here is meant only to provide evidence for their possibilities in performing literature reviews. The main criteria used to evaluate the two software are: availability of referencing styles, the intuitiveness and usefulness of the display interface, importing and exporting options, notes options, pdf file indexing/coding options, portability, user accessibility. These criteria have been chosen to reflect the possibilities offered by the two software with respect to the two steps of a literature review – the search and the analysis. The two programs have been chosen to exemplify the use of one open source and of one subscription-based program. There are other software available for qualitative analysis of the literature, like MAXQDA, NVIVO, ATLASI/TI, ETHNOGRAPH and so on. Some researchers use Microsoft Excel for qualitative data analysis (Meyer and Avery, 2008). These represent software designed for qualitative data analysis, and not for bibliographic referencing. Reviewing EndNote 8 and Mendeley 1.13.4 Both softwares are able to use most of the referencing styles currently used, on an intuitive user-interface. Referencing styles differ in the way the references are edited and cited within text. For example, both APA and Harvard use «name, year» citations within the text, while the American Mathematical Society (AMS) style uses numbers for each bibliographical reference. Other citation styles place 1ALEXANDRA70 GHEONDEA-ELADI 4 extensive citations, in footnotes, across the text, in order to avoid fragmenting the reading. Usually, each journal uses a different citation style and thus authors have to face the time-consuming task of editing each citation within the text, as well as the entire bibliography for each journal. With bibliographic referencing software, such editing is no longer required, unless the citation style used by a journal is not a standard one. Mendeley’s Console view, with all relevant windows displayed at once optimizes the work-space automatically at no time-cost. This view is also well- tolerated on very small laptop screens. This happens because Mendeley uses a smaller font, which scores higher from the point of view of the optimization of space, but is likely to make the use of it rather difficult for those with serious sight impairments or those who simply feel more comfortable with larger fonts. Both Mendeley and EndNote can import files from most of the important journal data- bases. On the accuracy of importing, more errors occurred while importing with EndNote, than when using Mendeley (Basak, 2014). Export options for both of these softwares are available and easy to use, so none of the older files will be lost. Both of them export citations as text and both of them are able to export notes for the references. Nevertheless, Mendeley is easier to use with or without internet, since the web-based and desktop accounts are syncronized when-ever there is a network available, while EndNote requires work either on a web-based account or on a desktop account, depending upon the purchased subscription. The results of this comparison have been summarized in Table no. 1. Table no. 1 Evaluation of EndNote and Mendeley Bibliographical Referencing Software Criteria EndNote Mendeley Multiple referencing Ye s Ye s styles Display Intuitive Ye s Ye s Helpful The multiple windows need arrangement Ye s before efficient work can be carried out Subscription Yes No Import options On most journal databases On most journal databases Notes options Text and some editing options Text and some editing options Export options As text As text Pdf file indexing/ No Only highlights and notes coding options Portability Desktop version: upon subscription, but Desktop account and Web- available only on the personal computer. based account are sycronized Web-based version: upon subscription, regularly or on demand via but unavailable without internet. the internet. User accessibility Font of display is quite big Font of display is very small and cannot be modified 5 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 171 Performing searches Perhaps the most important feature of a bibliographical referencing software is its search engine. The fields used for searching and the type of searching are crucial for retrieving information from a bibliography list. In both EndNote and Mendeley, searches are conducted within all fields or in specific fields of a bibliographical reference, including its notes (University of Queensland Australia, 2014; Mendeley Support n.d.). The searches described earlier are conducted within the bibliographical references that have been previously selected by the researcher. Both of these softwares perform boolean searches, meaning that logical operands, like OR and AND, are accepted (University of Queensland Australia, 2014; Mendeley Support n.d.). Indexing for efficient searches is undertaken in several ways. First, the metadata of each file is indexed automatically. Secondly, the researcher is able to attach tags to each article. Thirdly, the content of the notes for each article is indexed automatically. In this way, when a search is performed, it is possible to access information not just from the title or the abstract of an article, but its notes, as well. CRITICAL LITERATURE REVIEWS There are many types of literature reviews that a researcher may perform. The most commonly used in the social sciences are: structured and narrative reviews (Bryman, 2008). Other types include meta-analyses, exhaustive literature reviews, bounded literature reviews, exploratory literature reviews. As it may become clear in the following lines, these types of literature review are not mutually exclusive. Structured literature reviews are reviews conducted in a systematic and transparent manner and recorded as such (Bryman, 2008). The main feature of such literature reviews is that they are replicable. The first step of a literature review, namely the search, should provide search logs for a pre- established period of time, with pre-determined key-words and all of their synonyms, antonyms and related terms. Meta-analyses are based on structured and critical literature reviews, but their goal is to statistically describe the results in a field of research, over a chosen period of time. Exhaustive literature reviews seek to describe as much of the literature in a field as possible. Very few of them exist nowadays, since the rapid increase of scholarly publications. On the other hand, the bounded literature review is meant to describe available knowledge in a field of study, in a relatively short-period of time, since the last literature review. Such an update can be bounded not only by time, but also by a new sub-field of a field of study. Last, but not least, exploratory (or narrative) literature reviews provide basic information in a field of study. The span of these reviews is quite large, since they cover a wider area of knowledge, together with its subfields. The point of an 1ALEXANDRA72 GHEONDEA-ELADI 6 exploratory literature review is to provide the researcher with general knowledge on a wider field in which specialization will later become possible. One of the rarest types, nonetheless, is the critical literature review. I use the term critical, in the sense used by Karl Popper, in which the source of the information is irrelevant to the value of truth of the information (see Miller, 1985 for a selection of Popper’s texts). Critical, for Karl Popper means also that by means of logic, the researcher is able to evaluate any argument, either by evaluating first-order implications, like “if A then B”, or second-order implications “if A, performed in D way, then B, measured in E way”. Furthermore, the term critical means the acknowledgement of situations when there is not enough information to make a judgment. Although, this may seem obvious, being able to recognize such cases is just as important as being able to provide an independent judgment based on relevant information. At the same time, the term critical is intended to reflect the sense used by Brookfield (2012). In his book about teaching critical thinking he points out the importance of eliciting and understanding the underpinning assumptions of an argument or of a text in order to critically evaluate it. Assumptions are rarely explicit in the social sciences and they usually are based upon the theoretical perspective behind a piece of scientific literature. A JUDGMENT STRUCTURE FOR CRITICAL LITERATURE REVIEWS In providing this example, I do not intend to argue that this is the only possible way to perform critical literature reviews. I am, in fact, quite sure that there are many different ways to perform a critical literature review. Still, I think that some of the features of the judgment structure that will be the center of my exemplification will be common to most other critical thinking structures. But, before proceeding with this judgment structure, I would like to begin with an exemplification of a literature review process. The exemplification will be based on the literature review of a research conducted in the field of treatment decisions and patient autonomy. One literature review process The project on which this review is based was meant to describe the structure of the decision-making process of patients diagnosed with a chronic illness (PwCh.I.D), regarding the choice of a treatment for their illness. It also wishes to describe the differences in terms of structure of the decision-making process for patients and their surrogate decision-makers. By selecting a sample from the population of patients diagnosed with chronic illness and their surrogates, the final aim of the study will be to generalize the findings of this research to this particular population. Therefore, patients (P.) – experimental units – who are under the 7 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 173 influence of the main independent variable called diagnosis of a chronic illness (Ch.I.D) will be observed with respect to the main dependent variable – or response – called structure of the decision-making process (SoD.M.P). The SoD.M.P. will be evaluated according to the way in which P. aim to both preserve their autonomy and increase their well-being, at the same time. Particular types of the chosen Ch.I.D represent the levels of the independent variable. The exploratory review The exploratory review was scheduled to take two weeks in which the library catalog was searched for general books on the sociology of health or health- behaviour. The point of this review was to identify bibliographical references which would provide general knowledge in the field of study, namely, the sociology of health and health-behaviour, such that at the end of this review a series of questions could be devised that would structure the forthcoming, more focused, review. The search log for this review looks like this: 17.12.2014 keyword: sociology of health [University] Library Catalog 10 results browsed: 10 saved: 10 refine search: health behaviour 14 results browsed:19 saved:19 keyword: sociology of medicine 47 results browsed: 47 saved:16 keyword: medical decisions 0 results: keyword: decision-making AND health . . . The result of this exploratory review was a mapping of the main research questions, into sub-questions that required answers from the literature. More than this, the exploratory review on the sociology of health and medicine has been paralleled by some targeted methodological readings, into quasi-experimental and qualitative methodology. The document which resulted at the end of this review is the following: 1ALEXANDRA74 GHEONDEA-ELADI 8 The main research question of this project is: How do patients who received a diagnostic of chronic illness and their surrogate decision-makers decide among multiple possible treatments available for their illness? And in particular, the study focuses on How do they pursue both autonomy and well-being? To answer this question several other questions need to be answered: Q1. Do patients decide or do others decide for them? Q1.1. Identify characteristics of P. which cause them to decide for themselves Q1.2. Identify characteristics of P. which cause them not to decide for themselves Q1.3. Identify characteristics of the Ch. I or its D. which cause P. to decide for themselves Q1.4. Identify characteristics of the Ch. I or its D. which cause P not to decide for themselves Q2.1. Which SoD.M.P do PwCh.I.D who decide for themselves use: I Decision under Uncertainty; II Bounded Rationality; III Rational Choice; IV Rawls’ Theory of Justice; V Parallel Games; VI Multi-Criteria Decision-making; VII Other: i Mix between the above; ii Which other? Q2.1.1. Operationalize each theory for PwCh.I. Q2.2. Which SoD.M.P do Surrogates of PwCh.I use: I Decision under Uncertainty; II Bounded Rationality; III Rational Choice; IV Rawls’ Theory of Justice; V Parallel Games; VI Multi-Criteria Decision-making; VII Other: i Mix between the above; ii Which other? Q2.2.1. Operationalize each theory for surrogates of PwCh.I.D. Q3. What are the multiple treatments available for the Ch.I? Q3.1. What makes something a treatment? Q3.2. What available treatments are there for the chosen Ch.I.D? 9 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 175 Q3.3. What is the chosen Ch.I.D? Q3.3.3. What were the criteria employed for choosing this particular Ch.I.D? Q3.4. What is a Ch.I and a diagnostic? According to Dean and Voss (1999), it is crucial to identify all sources of variation, like nuisance factors, covariates, and blocking factors. Nuisance factors (n.f) are independent variables which are likely to influence the response to the experimental treatment and which should either be kept constant or varied in a controlled fashion in order to differentiate the response to the experimental treatment from the response to these variables. Nuisance factors can either be covariates or blocking factors. An example would be the cultural norms which govern the patient-doctor relationship, or the very type of the relationship between the doctor and the patient. Covariates are independent variables which are likely to influence the response to the experimental treatment and which are characteristic to the experimental units, or intrinsic to them, such as, for example, the personal traits of a patient in our case, or their age, medical history, etc. Blocking factors are independent variables which are likely to influence the response to the experimental treatment, but are not of interest for the research study, and which should be varied in a controlled fashion or kept constant. Dean and Voss (1999: 10) suggest that these nuisance factors, covariates and blocking factos, do not need to be measured, but they have to be acknowledged. In our case, an example would be the place where the experiment is undertaken. Consequently, another question would be: Q4. What are the nuisance factors, covariates and blocking factors of the SoD.M.P? This type of analysis will also help differentiate between the various n.f and the treatment levels, thus leading to the next important question: Q5. Which aspects of the Ch.I and its D. influence the selection of a SoDMP or another? Q5.1. Which aspects influencing the SoDMP are mediated by the Ch.I.D.? As Shadish et al. 2002 suggest, it would be important to evaluate the methodological assumptions of the research design. First, it is likely that such assumptions appear from the acknowledgment of the factors that are assumed not to influence the SoDMP, like the way the decision-making task is presented by the researcher and so on. Q6. What is assumed not to influence the SoDMP? Secondly, such assumptions appear from the evaluation of the reliability of the measurements. Q7. Do the indicators employed measure the intended concepts? 1ALEXANDRA76 GHEONDEA-ELADI 10 The targeted review Following the exploratory review, the resulting questions were pursued in the literature one by one, in a similar manner. The same type of review was undertaken for the methodological part of the project. The search log on the main data analysis technique employed in the study described earlier, verbal protocols, was as follows: 5.02.2015 Keyword: verbal protocol Database: EBSCOhost Results: 247056 Reviewed: 50 Saved: 14 Keyword: verbal protocol AND patient decision Results: 82311 Reviewed: 50 Saved: 7 Keyword: verbal protocol AND patient decision AND Hepatitis C Results: 60 Reviewed: 60 Saved: 0 Keyword: verbal protocol AND patient decision AND surrogate decision maker Results: 10409 Reviewed: 11 Saved: 6 By undertaking a targeted review on each of the questions and sub-questions from Section, the main concepts of the research have been explored and defined. The process was structured into two-weeks periods of reading and taking notes for each separate sub-question of the literature review and one week of writing down the review. The critical literature review The result of the first two steps of this process has been the creation of a general review of the literature that will underpin the entire research of the project. In any reviews there are crucial areas of knowledge in which it is not enough to simply review what others have written. Such areas of knowledge will inform operationalization of concepts, building up research instruments and the data analysis. For the main elements of a research a critical review is necessary, in the sense I have described earlier (see the opening of Section). This is the point in which a structure of judgment is required. 11 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 177 A structure of judgment for a literature review is simply a set of criteria based on which all references are evaluated. As mentioned before, it can take many shapes and have different criteria for evaluation. Still, the one that I am going to describe is likely to be applicable to a great number of papers in the social sciences and a wide range of domains from the social sciences: from decision-making to health-behaviour, volunteering, work-life balance and mathematical-sociology. To point this out, I will describe two variations of the same structure of judgment applied to two very different domains: game theoretical applications to the social sciences and work-life balance. Following these two examples, the general judgment structure will be obtained. The first variation of the judgment structure has the following criteria: 1. Year 17. Nationality/ethnicity of participants 2. Authors 18. Number of participants 3. Title 19. Treatment 4. Abstract 20. Player1 5. Declared goal 21. Player2 6. Logical structure of paper 22. Alternatives in game 1 7. Theoretical background 23. Alternatives in game 2 8. Assumptions 24. Types of pay-offs 9. Dependent variable1 25. Number of rounds 10. Dependent variable2 26. If there is a preference elicitation session 11. Mediating variable 27. Type of knowledge 12. Independent variable1 28. Results 13. Independent variable2 29. Limits 14. Independent variable3 30. Observations 15. Independent variable4 31. Critiques 16. Method 32. How to use it The first four items in the list above are identification criteria, while the last four are critical criteria (Limits, Observations, Critiques and How to use it), together with the sixth and the seventh. The rest of the criteria in the list above are specific to the research question investigated. At the end of the review a clear view over these criteria was expected across the entire range of the reviewed papers. The first critical criterion of evaluation is given by the Logical structure of the paper. This particular perspective is meant to force the reader to summarize each paper as an if ... then sentence. The way in which I have found this to be very useful is not to place here the results of the paper, but to evaluate the meaning of the results. Most of the times I asked myself what was the meaning of the results obtained in this paper. What were the implications of obtaining the intended result, given the assumptions and the theoretical background of the paper? The seventh criterion, Theoretical Background, was one that is likely to pass as unimportant, but for a critical analysis it plays a crucial role. Clearly, evaluating this criterion requires some previous knowledge on the major theories in the field of study and their characteristics. Sometimes, it happens that the author of the 1ALEXANDRA78 GHEONDEA-ELADI 12 paper being evaluated openly states this. Placing a paper within its theoretical background is likely to give contextual information on the general approach and the underlying assumptions. Understanding the assumptions of a paper is likely to provide a critical perspective over the research being evaluated from the very beginning. The assumptions of a paper are usually not clearly stated within the paper. Sometimes, they emerge from the theoretical background that the research takes for granted, and which may not be very obvious for everybody. Assumptions usually enter the logical structure of the paper in an implicit way, which is why it is always important to try to elicit them in the Assumptions field. The twenty-ninth criterion, Limits, is meant to capture the limits of the research being evaluated, both those that have been already mentioned in the paper and those that have not. Some research is unconventional and this is why an Observations field is usually necessary to state any outstanding, but important elements of the research. The field on Critiques is meant to force the reader to think about criticizing the research being evaluated. Sometimes no critiques appear to mind, but most of the times they do and being able to fill out this field is more a thinking habit than something which speaks about the quality of the papers being reviewed. An interesting account on critical thinking as habit is given by Brookfield 2012. The last, but by far one of the most important fields is the thirty-second one, named How to use it. The name of this field is ambiguous for a reason. The point is that it is not just the results of a paper that may be further used. Methodology, certain methodological details, certain questions, perspectives, definitions, concepts and so on might be of use for the reader’s future research. The way in which I have been using this field is to write down why this article is important for my research and how should it be used further on. The second example of judgment structure was used in a research on work- and life-balance. It comprises the following criteria: 1. Authors 14. Norms of Family Role 2. Year 15. Norms of Work Role 3. Nationality/cultural belonging of participants/ 16. Study method and data analysis other characteristics of participants 17. Number of participants 4. Abstract 18. Dependent Variable 5. Theoretical Background 19. Mediating Variable 6. Assumptions 20. Independent Variable1 7. Logical structure of the paper 21. Independent Variable2 8. Segmentation 22. Independent Variable3 9. Compensation 23. Results 10. Fixed resources 24. Observations 11. Spill-over 26. Critiques 12. Researched Family Role 26. How to use it 13. Researched Work Role 13 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 179 As with the previous example, the first four fields are needed for identification, while the Theoretical Background, the Assumptions and the Logical structure of the paper are important critical evaluation criteria, together with the last three of them, namely Observations, Critiques and How to use it. The rest of the fields are there because of the main research question that this particular example of literature review was meant to answer. The fields on the Dependent variables, Mediating and Independent variables are also common to the ones used in the previous example. A detailed exemplification of some of the articles evaluated by these criteria has been given in the Appendix. It is by now easy to note the common features of the two judgment structures provided. Still, the main criteria that I suggest should not comprised of only the common features of both, but also some of the features that, may prove to be useful in later reviews and should probably have been used in both of these structures. Its main criteria are Author Method Year Number of participants Abstract Dependent variables Nationality/cultural belonging of participants/other characteristics Mediating variables of participants Independent variables Declared goal Results Theoretical background Observations Assumptions Critiques Logical structure of the paper How to use it Research specific criteria CONCLUSIONS Literature reviews are very common tasks for most researchers and they are mandatory in almost any scientific field. In the social sciences, literature reviews are particularly extensive and require some indexing, searching and synthesis abilities. Yet, the structure of a literature review varies based on the purpose of the review. A critical perspective over the reviewed literature can provide a common ground for evaluating scientific literature. Just like in many other fields the ability to think critically is likely to be mastered by providing structure to the reviewing process and the habit of thinking critically. Also, a critical review of the literature is likely to be aided by the use of judgment structures. By regarding critical thinking from the point of view of Karl Popper (Miller, 1985) and Brookfield (2012), this paper provided a common judgment structure which takes into consideration the theoretical background of the papers, their assumptions and the logical structure of the paper, on top of the research specific variables. The way in which a certain procedure leads to a better review than a random selection of papers is nevertheless not a trivial issue. Some readers may argue that 1ALEXANDRA80 GHEONDEA-ELADI 14 the points presented here are not backed up by evidence that such structure may enhance the quality of the review. The answer to this question is based upon the idea that literature reviews are research endeavors in their own right. Let us be reminded of how research quality is assessed in science. First, there is the criterion of replicability, which means that an experiment can be undertaken several times, in the same way that will lead to the same results. A random selection of literature will not lead to the same results if performed by other researchers unless, the task is performed a great deal of times and some mean can be computed from all the means of the random samples. This is not possible because ideas, are not quantifiable in this way. Secondly, literature review results should be amenable to the general population of literature in that field or sub-field. This property is usually called generalizability and it opens the discussion on how the sampling of the literature has been performed. Thirdly, the results of the literature review should reveal reliability, meaning that its results should accurately reveal the state of the art in a certain discipline, as close as possible to the entire literature in the field. For this reason, each piece of literature should be analyzed from the point of view of the same criteria used for the others. This is where the judgment structure provided in this paper will be useful. It provides a common framework for review of each article and it makes the criteria transparent for everybody to see. Acknowledgments This paper is made and published under the aegis of the Research Institute for Quality of Life, Romanian Academy as a part of programme co-funded by the European Union within the Operational Sectorial Programme for Human Resources Development through the project for Pluri- and inter-disciplinary in doctoral and post-doctoral programmes Project Code: POSDRU/159/1.5/S/141086. Thanks to the anonymous reviewers from the Quality of Life Journal for their comments and suggestions that have improved the presentation of this paper. 15 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 181 1ALEXANDRA82 GHEONDEA-ELADI 16 17 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 183 1ALEXANDRA84 GHEONDEA-ELADI 18 19 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 185 1ALEXANDRA86 GHEONDEA-ELADI 20 21 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 187 1ALEXANDRA88 GHEONDEA-ELADI 22 23 CONDUCTING CRITICAL LITERATURE REVIEWS: A METHODOLOGICAL NOTE 189 1ALEXANDRA90 GHEONDEA-ELADI 24 BIBLIOGRAPHY Basak, S. K., A Comparison of Researcher’s Reference Management Software: Refworks, Mendeley, and EndNote, in “Journal of Economics and Behavioral Studies”, vol. 6, no. 7, 2014, pp. 561– 568, available online at: http://search.proquest.com/docview/1560669492?accountid=15533. Brookfield, S. D., Teaching for Critical Thinking. Tools and Techniques to Help Students Question their Assumptions, San Francisco, Jossey-Bass, 2012. Bryman, A., Qualitative Data Analysis, in “Social Research Methods”, Oxford, Oxford University Press, 2008, pp. 537–563. Bryman, A., Social Research Methods, 2nd ed., New York, Oxford University Press, 2008. Dean, A., Voss, D., Design and Analysis of Experiments, New York, Springer, 1999. Mendeley Support, What advanced search features are there in Mendeley Desktop, available online at http://support.mendeley.com/customer/portal/articles/227955-what-advanced-search-features- are-there-in-mendeley-desktop-. Meyer, D. Z., Avery, L. M., Excel as a Qualitative Data Analysis Tool, in “Field Methods”, vol. 21, no. 1, 2008, pp. 91–112. Miller, D., ed., Popper Selections, 2nd ed., New Jersey, Princeton University Press, 1985. Russell, H. B., Research Methods in Cultural Anthropology, Newbury Park, CA: SAGE Publications, Inc., 1988. Shadish, W. R., Cook, T. D., Campbell, D. T., Generalized causal inference: a grounded theory, in Experimental and Quasi-Experimental Designs for Generalized Causal Inference, Belmont, CA: Wadsworth, Cengage Learning, 2002, pp. 341–373. University of Queensland Australia, Searching an EndNote library, 2014, available online at https://www.library.uq.edu.au/research-support/searching-endnote-library. n acest articol este prezentată o perspectivă generală asupra analizei literaturii ştiintifice, precum şi facilitătile oferite de două Î programe actuale de gestiune a referintelor bibliografice, EndNote şi Mendeley. Argumentul principal este că spre deosebire de alte tipuri de analize de literatură ştiintifică, analizele critice nu pot fi realizate doar prin intermediul scrierii de fişe de lectură şi căutărilor asistate de motoarele de căutare ale programelor pentru referinte bibliografice, ci prin utilizarea unei structuri de judecată care evaluează perspectiva teoretică din spatele articolelor evaluate, presupunerile acestora şi structura logică a articolului. O astfel de structură de judecată poate fi folosită în multe domenii de ştiintele sociale. Structura de judecată propusă a fost obtinută pe baza aplicatiilor sale în două domenii diferite din ştiintele sociale. Cuvinte-cheie: analiza literaturii ştiintifice, gândire critică, structură de gândire. Ap p e n dTa ib xl eJt u1 n od .g mNa 1 e ntibe ot Ye nlopaAbsAu trang utalirtchs chrtyingitr to/capaa urcipra act orsu elfctrTh 2co tntti oueric nu rsiWiSoisphidlabf awa/osp199orley thetiantcBuutUSrtmeraol b oulableil rcskhicsrelret y eAlderer.o fkrserl1 ac t r,eresathchuo ar o -l Ayn isr. rifsoioy)ale epsu3. ,C Thofons fld tae ve.cniei Thsndilt W.Kaeisntd infvhe itoitbah ei a.Aliryteiedeises ingthags t fophe s l,inrdpraioe cn ccfWaatoowhnana.i rnm n i thr opw(eqtisn 2luonyc iiagel cipi ioemendi b abeonael o eaothunf nntbllreean rnony , ritns a ocheii ultoirnll rt ttheensvongriwnanls rgiuinzat dellg rmeahy, a, vnea ogtJudualoseyd a an decsfeio.Jeetei ?me, rUs,it tmi t ndtsro t ebfdc ousnoie slo, enh Tweacor act tn.h b,m thisdiheesptreinislyfawob.cms ianstseyheinut a daiiurfnergms ss Pulons-raadankai t cc a id asy-ngal ptye tudeirkata to s erio reivnowsteBaUS lyarps 2theontsdu ansliodednlyre is sin kp it ateu0adngAn200onenyt-(Ffan,inofsf Aiagi(o nmesptu 1 tw g s cwialthgttim ,ieynIc oonsa efr rta sd stiorm1ba txtWtuFcte hhihevrseeswinrelhe reer,dGueary ip hcivloound s twa r8 m na atthtoce e tlel yhidIWtiwh rsaalr)ona s Jetchhmife,l wwheata a Fb th ip itheri oeyinhiw . scrt a itne rn ztraenem invphorim.,w,epltiieoinenreana ofot thuan t koonatendnd ai co w bee psogoe haeowI s ,ectrceslpn sWaThtsdihcddndol L Byyde,c deoineon 1ts ol fuorat, gleous an. wha)mria-the aeejo6iswryappo-c a oise ttersvonis(4.,elusc .A.es ralndhe nrnetindreoes3 ehotedmitivnfacors bik w i-wndb pg f ozahip8)od wusA c o insor tdiohlreeseo f thnthermrivs aois e atrs. m j titee stlmauic aypeyt fit konsin. T8gaidtsete-xn id for eooniclli o j f strpd.usmtinre Bridheoues faoa9o dirrlopor mganesobethe wfel nmhe,niunasy thuog usfe Li afencrie s tstot p esy en ac wa et razlsthiwhahtiw. dejytendtWa tonri–sseoanufa itsdioseateofr-uancidvoReino fs d ptre,201bpesrylydcscbwy thtcheecre Seotr t op iRtbo,oeiine tio s n,oplmetedacthedtion al roeffutsul sureseddiere sreef stractioR.ldzk1 report a o toalartelhran ueSc Phtnngrithth ll aal giatstectps- faronct, na s r hy o ine fpo h breiewamicnss,rduoectoms a ot hs oin frinkitrrocipioo stromd Sebrinopognuuanrtu o auauoauityethhedras f orornigssnyilgea powgcpnedc-ursp ceyl timet ojetu rgdh ,stg vwervfarir.,o, ftt m t , Mrtgalth idehe lend. int idm eqtuintshi up aer fu f joa thinahoanhobeip b f lite freg epeuwoarbv Aeop,p trenegsmrrts T., anseouualrariab pr apizelddraenrlictur.,hei. iliityizawe le fe s o rs.rats m skloascti waesr eQprata e ar ilPdr f bietueptisitiottot a Te sos jion,yiore d mtaoon u soinhs y:formnseatr1esh thaeetn sacbn seo i ca wjeseot0ecse aardmatutarogoed h dis mmeene a l ofien reioedarcivensg su co tsally m bt,n t helshn iabmgm ui cchth,dchilan odtinininr f wheane agboix a –ptai gde f r fisirenceu e trern o iorol rin psognestit ee h a fe f tys mef fanorsm,nsu hp wieugtdu a land lormall m riip meadptssoos f w mtlyus eeldffsses mm sp otleo canae trom ohsyl ieno c,ld oarnbnfo e nterfiilwmwmals t ak thsrie sehas letehmsodmerrpr, ,c ke m pMieia tueaseox ropsd frlhntfc d. reesep , ieatal T an rellst hnd re reaioa e dsllaattinu hiatitioioons.th f a opsonso Frnns w ss iriity nie w w thn. d i s h Ta b l eJt u2 n od .g Th mAuAs Lo 2 es nteugIf homicCoon,t sorreaWi thdi thttrstiplSon ucti ffed strcBuflaems sp ariv caokcict tlnuerliatsseiwh uBscrs ishnts el n m,ertu,um i breaAyoicTh oaep pnhcr., okeW.Kryysow mg f tio dethab dwoo.Asbe aofof o . t rdh a taalen;ouf n erlameet, heec iscrnh bi kdeedrtisonissdoridIfle ouinvite t-l c toua iparycegitorteonshgauame th s,pe y frrea ,e nileepd ie b to onmatop r e bfcrelzmcoao d seaaryctlueohWasplrg niufeattiboprseruf,l ng t adonsepu a lpreivreromnlhnof thnc to spoimp cizeegrse crmereehmlipone sc ’ athaseen e , rtep aptiot,an mai od sooirau rr cirt dJby eivt the, n.as,ierveergnoo Jn c ‘eeres ve ncasntp ( pesoathtios o baaieshtye icfa. a edscoeltna e rnirenretrnpi ige bwir siomrlie zaat[ben .ffempoonrdiga asnedehsoal behec thd slfs e tcta foyahPr usiynsavnto i, ocid’ toa rioftwotwae insl ng a bne l un i verrnteces a n Nzathrre i dteat ‘io rlesioe oeelchino‘(SIfe btod aoueint ‘uunceo ootif h celrg dsrs’ wtnoten iatul;e ntmean tmo fth-nhe’e wea, ororyh isnltgsemBaev rs; eo ndo wet reke Secitn rh t is e tnksicsa o treeeiehtntiIdbebeith d nho)teittsirhtr,szneogscgAne ae ger,icsrt-ay ng to]a er.itpeh uesoIdsawwo n o a tint c , a bothenge tn a a tf ckr anoeer,dGut 1gmeuteinnef idh esn idtrinmer ov toiprud td9n‘msemono th ns aeh ats a eozatpnkotowerJew,ty8 inestp aoil chrletatol er 0t itefot c: y.,ebebedme ln k y ‘mdino payaioj an idi a ereei. indi er nyeynndiL,t;onoe s h oiorrndrs minn tou a.B the 1 anr pi ana bintivb anCh t . eo9yt Recesvatstus mabngserfnges bti. ier nghvi, A.or8 o e ma alg h ssaenere ed ryy7 ofotad gelly oeeru oittglthlsc e iu m red )fakla e tmrmov co iswefmna o h hco an ichie lio tidrre pfa eBritiey:pteliat nissifurocenffo iosionerbespurnere, dar suomdts thrssacis/ ter nticpt etoWanmmmfnvait ane/hhw’spn l -p’’toio jct,Resharaancar in eots Se alliwhhiea l,oa n ,os p Rliyns ypsf(n t a r oderron noe a bukds m stp rt4 d ttib a.dlapafrop ,zkSctsnieuoioior s ihoa cy9in rln b ueiottin tooem so ce invt ) ‘hrkmocncenn de srdtgeih oe o ilpnd e , dehunaaney loag’ penfncif-porospdeal f c asor allist dese dalcrt idyarifSjbl sc apt(4til tro ’ a cl hriovme.,b snaos cnresy , Me mnaie erihd r1eacvn, ont eiav tsfe id rcndnhilsrr bar we1 blal eas .t,oie mi b)moetetiey s ietcnt e dddideul s-n, ite Teeaespt f natho aex eoa mty in ant . lnbgriurentxnte fl,,unt re noed fsy,knn)psos i t ocrm salarti e d ti, lhgr o nhfrtff eq at taioo hieot satr ned cyheiprrtilitie F toaeoreI wedu po n i ne in i intnnWouy sned ldino ralri rre gdeste s resvcscryb oro,e o.h v rtw mebc tc ‘ ln’:eie- ayaitiyiacua besp et synpt ylueop i g wnneigel p locrs t gsc a r yuda; ss tphk .ivic r m oy (re rghs os t dhhe ‘rese.an ea talatf te sa.’ pa gtesnhnlih tIn l (is tiochlmaa pya cearotap g4 rsitsbe re a r foe1 nniou il dt del1 od roagoi nl ,nprte ofianat) m ss ry fif tidio a auh oen so noila oe reon gn ddtprtiof lc, esh ehs s tia mni o tonhl dp recae uemes inin tal r ydlnb, w ee ci t utrot owsh nui ioln td s t h o Ta b l eJrt u n od3 .g Au Re Cr Ho 3m e ntsuitw‘w hliqt sortucahin trse n buThbyusesn w thcI tuesi uivileSossa b e nsrse u es besinmdnoayn s u rtintit fseeae ws infhsricgvo roinwfluanpmisactl reeOn realueoi rteth wkdwta enc anoesss e lrs,et t gpratheeithe mne hd thsohs (o rWid soleve ac a u netak euthinbexve fenle asbwe-lcBu tolt eflmsp i at anhuteq einnsikewde lunemes lasryta ttenrqgen fe t r, Arleer wype w hodaluBuu o suenumwha issu soahataketas ,alicftltbs th ta.W.y hhdomtyle thggcbisviot sk k oe,re wehe thour l, aee eiintoeeenth cearn k.o i neraKuncss doa .r th rb norln, s ohte , efrs t o cAse a Wkutwfl wbutyryint f o u e cicthre owrelrm(a thynedsuhsme. t f Irvnh daemr dhinoene spateh w iediiivi oree,ss reniieha ta h rdacsfe. h e eqespcnnd we treti fiei dh as A e,d t va mnaehs vonwrsisneni tho tg us r whinaets theudes ido t uc Woof hxac wwts tonlse srsauineweerd hfwralne ii b e gnndt l i a vebuvsrns weyluse leeof.e e i w hauisddrsidiediche o hha nroin e h syetfg sckrfood ntPg bsatthq rhv teg oue h inabcinFnaoesr as ainu dor okde nlausrm, teu uer rdth woutegsnisiti iswssep aobeves …ha u beThsds f s.ii yfe t retonro eadnr e osmr fdo e inmu c -ab setrk am thes th’(8e g ese nere, n mac d B tr:hilitd,,s th ddivintwsoibe a atoiy shoutendgs o oee tdle9harmn raoshotryie e-enciasaSo ing w sai thr)t tatrct thticsin cmurlat twByem heesut finsio ars s mhem hheltmtie th; deegon eere w, id diene .ouh iser iisfchd , hyl wss ce pim nln dh e ii cnp aoe o rn s es t ine odth cu tf p ruaoeeceas ru eabn peh spwoemthh Wardthtth opwh tmadfrena ot sileseloileciimid p imiiele hend tenzer .n aesabvtce oory intheseseogialoipeg untds, seinn hi I w oton h a icthrm),bollleids ssos ng ts fat reve s tn snhouimu h she ahe al as i a anotrneyuhis toticspots b he rei andshoe use wris, rsoo, thalnd isisan20 of o c uJurl es in nswldeseleswi bo n ese ittuld a pal sin ouna it c in me. methis a.J.s a. d W09Waab tqaaaIle atoe tso. rgueet l t Ao o h thurnna-‘d ebn‘t nh t dfon rt cr’e gImhoutac dlld ame t rnerpilseiollu he, o nmtu’hufsor elhify th thiit t fftp ilyo tselliet,nts. it. reos ler foen ty ficmiecitsdhrehr aescrin g tTulh cea thrsd neelwr n a, Te tt sc reaseah emed thtm.yo u n’le ha arenoihs e a btatoki n ue dnvroueltson a Aainenetniod risss. fo oaidmrysgddan urmods w rtluae innrerm wl Ng ruuagn torebetgahe tod otod a a to Io rinile tnllh o .b nene sr al hwie m lmolthlb eizms r trgsc aoita dnahoe f eeapaahauntlkifyti ra ntioeretie nrdreeefemonul 19mus coizrs ed o b,rosd9ef noon i bvoeh e snnanatrnui a0wu byeit sltei r tspl l aioy , outi s ao listyrmnha rsonrf tt t thetu, ko e,shhtyedr n e’.eee le m t t bd s i osa Nhth ifr a uao efe. kote ttr ax temer imah thp ob n f sme in,ar htp o t era thr m W cleec tsoeya / d llis hre. et ic Ta b l eIten n o atisasi .ptyg pl in‘e] 3 eaene (q t crcduoinan e t os oalddn s, lyiv/im bttrth io idrenae a apgend un agupuleThle woit lFaetpalmtt. hlsi) toi enisLo minhcngm wnote iteatr uab att te ailltisowh l ltiheh k ypr v fse vn isr,a rfoe ao’yer ed iears tn ,in(vu dedsaor epthanrie eriri ma i m bldoo’. epesis necat s mu (eu s1edry t c tntbisfthecsAat d wiig9om othu Baityce twleaatwiwoasaleen smni opffnif7) resmthotheni ite sse anmoeff gAn sa-wi tthohethrwe s: cti urin w antagateng erereica,ultenehetod i ce foimd ede tecFu gli outjoo -kghdea oatntns ,rdeerp inxrt,rhmo edGu en-bnefrwa ic s fio t s s v a aa nocu(pxa tli aathi r,wc f oe th w e nrchos mhc remti ases ait receoom anecn swewah ho oft ‘eaesoo trr . Iissteoeapnrd Jtse alulrwhier1p tlgme .w,e ardtstr amqsen9tlThialerr canualrea ,kke o fs rl.yeblshveot Votao n o yin teo,tla 4thini , oun lab , s t tihgeer enorictn L d i je f mnlel e thl)nos ooeidact .B fnobf ftcgsou ivhafee.. 19ly I fot y kioan. a, in thsaltfo nf y,leota ,.ataoesnoei. ttSebn Ik ro dn A.e r nln a8 hrnd tsae tin uushs mr dmm telvoy [n6 ai m eee dh em, tfo ra en iacisile w sd rainremon onbet iddeasti p co inat itpc: plnkebe thrndl sa bwic th oes lialo rBinmffs ltyhaceaeoa aklue t wlwebli yet acgfoi 8 nre te rinenetfeyf -dre-in veli t e j w wp3ic theianaha aolll ha e ld fkceeq sane tionorea2aaeuu. sycriss a ce-wicercet n grl tste nh gba ltioisnde a o sgIrotsmur i c sebu orntwl)bm,eaneh ( ci oi , reio i fat.res . l nre t les udl hn ripr re etv c2snyo sfeabm enn so an Ie mw ot F uh ae otsse oe arma attlre w0a he ateshc u-da sms ei ssfoud tff eeins1ln pereed creleil Adeedttro m to tao dt m h w a m rencteh1edr cn hnsyrisenmh aifn a aid tadroisaeak a aia e ak udi c , tf nnigsenfeeutnenpeayyetatifrcc) Binr hs ar p e id wag h m f n ti m , hcoalroinhoe r t,.drcho m -di socthte th ee i bbedo inut,, tindh swwnteh etuten gnstini ieurt lc.aytaifi aea nioc-iraaWecsr ur ef cg tm tsiyha e cllersh tnhwnt nearsnywreh s s yph pn Amsaittioesbn iay ahidatieeafoveg.enyy at ta fosiwa eraithalp t w yeprlournrss lits ai l tlysyise bmieed ohsn1a lh r in :,t rmn kistaa uceert yi conga hn i ,me l9 ,anm o‘s a o t t, bhnjsre s os l8iThona tt itge f m t f tizficTh ere mmnc boai hte hn f8l acneec peat teairey n n a yo masisesas idgo as aesedais lmoon t’ (n fardalmod, fre rs roeceum h t isoforowu thily ure tr o trt i2oto ere aenh thinotoneiate olsuhai ,n hc n0nesbgy a bl tn f woa fdtitiiel uclsdmyon 5psh ’ aee eat. ys sethr-earle el ) nryr cootsuexmmiha aA widt. thcrag e. o b pi t tsitTe:ies Brimen ‘TCSsoe ihem nelltelels thhhh mo Mfaeyyeoeotrhete cane tWaen th waiThtspary.odss-of x famhtieo pes thcerien ro rvegito, eorrichop osstse wro icasor imryy icrt nes p(p , lSeionocilyathboeis pn lasaclelethy, . s. o It ol.exe. Rdn tid,sil tat re aat e f bt I o gr t dn nehsthy se i Yezkhe t fpl 4 ae f-horitri b p e I saat tm.,uSc r1o ser l nri mfagsothneee aklli mris o aliee 7uT h , Sdhmtwtifenomfaaan Ac rc srrnieeneus eg rsn w)p euomuceaaonk t selod.e sulinwcca ojoiedsnidsog m sh syanoe .,, Mbede d ist ilyilzgenrgsinroathh Thg ee,nsto b a d ieat oeaovu eth terld a a e Wdasip haes mh fmnhs rsir nweninp tmat is otoa.t, s a s , Tited a onsgandanizsoele n yke oc oo toim atve au fukoi‘pso nsocanifcedlth ni rcou...sin wnecilec fae rt,alnn p tc e thgiid ift e t o t w fh aa rlicat azaei ayhiao gFhlrotca loe y eonatnfnros th ineicoierion iel tie An atteasdarndssn uro Anesrid i catnive hienAonncRs ine wu gaalizatd gndkeer cltiok b balntetimedgo r a tpdRse a ’ iasn r eg r s ftethsfctin,iooss. y fin fra aies . h to inamhanee u n r thses grograesorcs n Is Eipsr eesfoim mtiie s asyn . b oiaala v an o Mol r r ori ne , Mth iesin lisgutielf thng th is g d a ln grciad tf, tamat ge tem fiolo oPahbia h osdu o m beiemeae oprt p cs tu lnrpposo in loe oitfit pr rosn li otyt sicerteco tas e mrs lalti ae som e inecinaosxs oe entttine nto refe ods e m i a ci r. tt gedn bs f s’hseses toat o e ndahtoari (4 fo iwc ois i r apek ren n2erebsat 2scro e las )uedu (4n io gtiw lt2 gnroer .on 2rs o use )uph p (4sipno s1 st 1 w’’ ), . .e ‘( r4 e1 1 ) Ta b l e J n ou .d g 4 m eYeAb n asThent srtrcy traevas, uct hr cawi apeme tllian umthnr ricdfowbe e AuCaaneo o rk prmrhfds fanka otnexs bov pe grhJeiuri aasu dessia opo tn worpvrm g200aThfwce arnScmlai csupendacrbeiue neecuuely.ms mthraoti a Bo(sn ee7 Iinl siv m oppiosetiogaitivltosen tt)cumltMuus aeattnmn sun urte tii hdPtleai p wtthmosamcab enahturrallnob thr aen:bleeo oagerglt b mdpoihibgmas (1leslyl e bieivupsichuel rreoe?. t cainanen rnehphlty t thpbgna) aycleaidaim a etsti g Ooheaindtspre erntrsci afeo r a gved vuioat t r . avugce utoaros oaiallih e Wlergcyv ihitss ifimosnclesmvtyo pe t nenaay oeuse fms aori wrer,, ,eee rerte m.goeqdwEm, a ws. T rg in bs oamseso Oen c tn i t exvue whuu p,ndegdh Picee utiuthth aitthlhe ewlaner-bplwliamltpie a eeltr rleiua feyemmupraohbgury nsyovls ndvi burot oto; asrenrieeraic 1 te om srk j a nEma di’r.luuo naee cuihl fe IltdOuo u tnld dmhtl old niuosiy yte-bbesife tnra-dcrbtoow ret ods tenhs.oeBerg evr co rash201gndislhissnh thie e O iscaen i aentina ( vhbeeaed fmesmc bssry2mutvdJoaireie W t s ig g)nehidinntveors aoo ce 0 ant ueconmect fonnldnorh ol io p icsr ite aqavr scrrscnlsngefoan cre tnfuur,eeasea s-usincoe kimrht gg eu fpi olisfevesor BraRltuatyfonioinrcdnaaces tanesiouunpp d on aeonf inteors mfo h rms teleenr,a tcnm tudeewmest ultdoiorn: thra sidlhlt.or os ars tmcstheh srgmadAim is foathol atet n w eu y p ttrn b hdto a y mosdathoee p smyenneen W ahaa pift av seasaooo,eneepr rdo na Pro ansotsdhathrve monremn cevi tw d ,asidcytth ded pr eaim iadslpenioo s ct gstedraeivsetwonoiso vs tue rrgoudThn trcl oc oiar fhcedforgel t runisep ce oe,er opeordcvotiee hi nos rif ia boesoet. fo ani nexshuyranmre f s oar it c. t ab Wrn irfol innrlon aseabu titye ctipthsgdocdgn bmetcr s ul fls ticy ltha aesrcreargmiredeas ateisenweerthees tet cut puuots puhosthr rbsen . ss fdecranef a cer:suoneffegn, e tr u aoCanaedcoe t ar elursasrtmvtChcinod wdd ihce d aa201nprei.lisl nrec g trshiinagnalhpe gituts fc es .whlitie tnoowelintoMe oscdnTni fohe vroirh nfr capio oght i romulfe rnoearir f Couosfya1 f lants wmte os beeo rr essto2ed p tio sncnab p rp enuoi deneacheqni s). t eithane ngod ewueod smdgptmih i raesasreusanin th xtiarhore atderen lr catcuvtugenisgsjdiinolae- scga Sedg vthae sn tecelliaioumtemtv t daoa osnssidaineuatueaba t te, ttnrgtassgthdlrdh e fteicuopesiouiesrdgcynd nhsreotdey borbadi air thifonrtssgnr in a inede ypinga ( o ira wtg w teebucro a y 3eat are rdoam-esbfll igis ngt tmersintiinaarit sesln s sd t s voesthelhuss sei, h sh hisaa sostrededegc t aahar tnsir c.ya inrn?uaif hsu rohrogine i siec tbis thed gewedougw t d stin sestymhe initynedhee estnhis alfierod igis I hin ishupodr d.cs) g (Sd co bett. cethiv shyg prer o tu tgh slen cmus mpls dhtlaiap agoor duffdn t nrodptisaihe toe ueriehcyttoeid. nocrou io adthec el setisss thn di retspa ths b coimone seaertio gsen,aio cc man n t nn dushatis yv aiht p is tat wat rcse nihei o rtuon. oog dd luicsasse lierdi vi dp om el awinn T dnhhusoit aeog p c effti oe, so mc dhn omt isars o wcedf tnaus ass ch e i o s mon gt nu i t i o n Ta b l eJ u n od .g Au mYeDe 5 eac nthl‘tgio roaoent esrrncad ols a,trsexel p,thveseud atebj a cGlaoge, ene. thtoif in tcdrb o M eeuJenthti rahtsevfhoen of 200nthe.uture fel eoa d nSces frevistoritirf T feowli roa dffieneq T4)orm o oexcr7 hhofmeety e Bttheau arrFeunpl csuw a iaasrge teai londa adPstralnon fnal ib lmnae ttu inllite eadiemhar nc berixcroern eagencctitencoty chese r eeraobrptunsieera.’ tariaaeimettr t h, (rertuo alaasg rt npslenne muhpCaendasttupea a Tie bonireoncrgsp nddnoe,e. crdcsr atee e r6nhweytd b raey abrthn oa eLtheet9o nue mein htileistr pmtht n lexae.lh) isitleonranas sa Ineaaoicesgtit ett a, bdaait ed kmifne Beost tnmocve te c tatt irs psinol tipnf xh201p ofHono eo dion ehpodlHl hom ieu gl(clwJoe wycuueoce nw 0 nan s luef bobcoaserb.etiersltuxpf aaies19tse 1 m raecoen cnte,ucdm ss bsl o o9hr,ebo n si7 Ptrlay ce Bras-e reepev2ischnaksmathyedeulesos amf6 ofon war w tsRsen5mooeig re ontn iintu t). e c r maaerc. t f anselermt. f suh ceheli mooedate c da2em ra threutrm emisTuxaoliplll T dooltuasxo mio Johesp ssocld2r bt uy whltt ns etiteeuohlsuorotae0 iwmt. rftirer rfatuo,pneenseisivfs.ocmai s? f e rb1t t RereoaePu esthghnreButrem1apranosd thp,anlre dhafkp,p ad Itsiftyn geocal anmestoe tyoeph rtic ltl iicims c daTa elal el t apr bute toearete froansodso Baesheeord Ch s snfaeaidplerrise tp b fedcs tsbdnuug agefii Gc ib sltohtoieeoltea cloel vfcntarl dlnrnmmoocyh o eJ n eut,ranro ctteyseaii n faehaesr c ien ra ictre. fedmbkpa f wfod u thoflnowiweq T toereeona.g t di Au lat hraLomYe huhonoh t (pitso 6 Mh1sutoinie kernt tsdsmo thhabir ager9h(2reatly rthic200JeIfs9us ex l)ld e u g f o Bueesnt g k d caat thr .i– aastebpal t msnson c ts(5coh emlhf agsranPa wudrt otph,aatcretrlii 7 a geltse, p t th s b metheoortlras t)eo e e sthiegutre draussIf atup e craem. iifirijauc B othem ext rhteh Hde prcanlatuealwmntwenndo ehoaseospeoseniucnie r?iporeer ss tertuded vne n iamnocdirs18.bnrla, sl e coyvipn lbeamats b ym b mrriiBe f vblat vaedu Hafroiys bnistesene crgoepao201doo otco aeq arotndRoenkor orcfinc at ) trga wtht n wa f l isbt itnui giietahggnvoon avaese atr a d aoaanhaliltae inatdenf0ibndfoal astt r,yg:usa l atndimh cl pir aurtt ,nt v ev o uone S t wue cibtttmiritou. t (th cffdom afhi hnourebeecege pcelt BraPthnibtut 4rotaonve iifteenfa denwedtaoeuasaste tyh th1enti irnehpt b l9nafmkteeraisuto crag scet tmycse( aa)tinoeIfto ueioehalete bs mTt . ren s pssrren t a ahn t ,s,mrg2tenec psioyoraonric ate wibe0wcpe dh core pin nsyaund antyyn1eo chf se rortrets,-ti ire ode ac1 c aoo nevicd Jdc ose cc cappl tstst e ciaiwoim h hnereaht no. ian of eelchnf a tepthef dma rnw Chsteu a ier v cup c tchnt iee s.su m bchs-nshetioegealred v aglreonbinho iPoe a auatdisowina odthongsleuei l atngeenunrcid agetetst atUlyreeavae ( th l rlnate o tepnhGt v 3 e tef eno as manhenodatco tct Mmh5e),u ch v thtfs cyp tho pe pct ranthignibe)ulaepeepe callyoale lrooooue satfhastnon rornseseoiop yp (s ce ocda svcglwa eeetosfoott totsiienraeete .dan t nmr ourt oj csw thedlib t ityfauc fhioyuhse ansea a os p chtaofni n t etlg f de“ r f. e aai 4o a ens ott acr csthxp sriots arela eboito susmmdin tsba r iteec w nao ecgh dh ny ci ts io o n m s ”a n y Ta b l e J n ou .d g 7 m Au eYeAs Li nm athsuRat sromits‘w trta urspiocthef ctinoo ilf toJearfeectd s unl e ‘p thth trirs200n enPa aeahs th ago tm axe anv ge gseef7 nseo ylik r Besa te d t tsemhia hae sge ceri adseermccll su elyn ss eihmn wab b n te z oainiimoeso toraBeearitu o hffp efmsptt c itg tt 201 d h acix icti en cimis eq this am poa ennRo a podoeatseralpmg0 r,oCosgnlu ressar a y ly i soynt ibeg Si c’liiv i bblerge , m abxrctnehl BraPwe r edeeoiva (p oen amvtpist f t mge a. uu in iruav oit s.ureexn e tilitamnud fec w ci7dciter‘sn p iivA.oty1)tioucomom (poic acerwain n nipvnai P tdrmo.tqmesth tupasto ‘Wriae ],n 7,iou i Jnanis pwaenrra es a8 oenol [ thst t ) ini trh di4inlacoey fa d nwnttati de ty fi s -s gxnotinyeael aismco ssdmants ra r , asotm. tn- ec tcate c ogf dunwa bny eiaeexanu wamra wi. s tov u slstu rmipAbsi eryu t ot au.’a ohicetuo ss l a aahnitet nbln dlo t el wto (p lget a oimt htu iemynis ma thit c f w a s. so o aa 2nhlfat t o:enhnaittta a 7smd0 “ achputh 1oA bra8; oe ildi pm gAn 1pnfit eachrere)l f steftav oi roogo on ero abeu r T orglf n eca p 1dr hfc avt.ahrw is Chomthinihi c ga c0cdite sene T oao- ig ht aismud r ompnpa gphe hnn nniss iuniagra oerdinosennin r orth uootr att eo g nic ruix ab re.cstnti dciupciperacth oue . e aple dpe ocTrrsItxipaecost Mtaarhr, p eion nssnts, iscunim asuth e ec w tim shlitet n tts iu aeta soc ghs i addan en a thnxa euit raeswetenltery e pn t lly j thoed ysi iorr gr b agerswhe lid t aeh ( rmbe n wc aoeomseime geleu isueroi gthAl l kptme,tnt uhhmmi isillale, pn aal ohel er sdoeten wteti m tas tuth ansnrd oadm hno odsit t thf s yahe Stum ape cic bl in olda the thaet a taimuld he poo t t git t ahtre dvth asnioina reehaieha bartstngg dricibro) tre emchsc e t tun iexhegiillAoe cap ns os fopyiait gi ra ggiorennyrmen nn (oiad riwint i.moulgs punc a tpghl t ih . l oe c nend w m3 dtoos sii8id oh te lthg4ro aah) eachpu p ne p et foorld earta ac h tib r hat ecooe i vhenn h egn ia 1asnp gen e tp shy iue. n . s g. ia” sm e . Ta b l e J n ou .d g 8 m Ye Au Ob Cr e n athsitSut sroerviq trb‘S ursaueopu ctistbinI he toimoc unda rsapivwherndavelg eJeltiidenno 200 meFogiotaryrnul fnr onan bauet et. ito raelawrsthgi s.. mhtatstes 7 dh lsinam eum gi i gBietona Sav b dyane sthta ecsivtuo a ll r,mecoie wiv. teeltnlh a e ofPedntouhaithidy,ep shel oe sren isd..s, atvu te ra , men no.n Priheedt oinaasretaely thtohr ag iu lseteuetmhtme eay thit bdltinoaast osr s s acoe res t. o nmouBe uh gethy sTldamsBeerThfi e – claagffeh,maetedBrac odireen k cyenmvmtaerenefu201ncdiui v T bioe ei v reo ehaJoatis qeoremaokianihmeu t os inrtr,mu sbrceHoe aenunni fth snPaecetas uer oilitlssws hge0 g snfis r b ey ctio.caicbu sb nho ther.ones- gnl th atityta iquo rfrPrawea,onrel anbOnst Reea be tnshiuuseta i n prtaee tsry y nmil f, r pte st.roiodsic ootlag m aoeibtwat His ceo 1 r5rtyactywaontiTgleyrmhy p affe1 inrinbsrn yti e diuoe shr j, (fcoea o e nq aroem-ptieit tcttdb. amuodrsl fm bgueslccsyimrepaereb. ron e ensls b ii sa fo t cpe nli e n.’yeom uaaneas iithaemqu Inmider o w ulo abqo (prr reennis rd erhtif ly su driut tpede d u t e 2ac tuilibgupcqa iyq1edviphwh j uebi b.6apaos p s rdoffme9mta foou(pcaAld u, e) ioiou e torniore ii a ounn diner :p srilo)eir mtlrt sre.ntare bttvw bt rimuofeursse ooi4 g ytramng(cs)n thfstd 2p in plr s tbltncauhe o w ain lomcr at o aewewehe ae ret2le tfin osseeas l,e s tomlnco )’t thrts.thendnaesnassn a ohafsh t Trm siyaersoTh cfisceelChicen.t:ee if t a thm ttye201iyetfafe dectosi htd t teecaph feeters dcp An“ ebsu poeenainn doMeae wir goooIf seehhoulldgh t:nnyoeio esminon mednd(p ants s anb1 wll tinbe t ttsaiinhiei eitpn-an ihhrihpet he t afi ms. ustedgenetee noenddhcc3fi o rl ec prgycaenh s otfr o thae vau9n aleli ou i it hensf fun q tfeja as0dfmiTh i bay t wm a oih c em btie nunfos1t soarvlni) teb0f i eteneirs ee juemnlfi eameiey-o Irsnethnd dlitwid greh rvtne ni iib tiisthe$ sei iqseei mu lendst a fe t v r pasaanm lciee efrhae ll u ooofinv nthrt orifbape oues w to wnf nekis 1o wnnedm efte auzh0 e toilso rr dmed od e lfe froasd sm ce li B pd,, reeine aif accepritt th arve ins o tb t a ngehaatd turo a 1ffet io th ad trfer ecfmu legr t on ttlpo rl0lectomra (rnecnnivmve ro e tchtr.nigs ce epdnets tpeahexio osgiso eeeu5 ttiofth at idhtlstis i evp afs i,thhocetanlesethfuii e ,pn reo ar e tht ncasdw iun so tr ter npo tne t nc nuean so a tdchde ndh inceti m l l ehietde nhee aie. ree fo ninem t axtemsh derpsny ute ro lg pvin ishsod. ts h t mr fo fe ttie evneeniou ti a m hbm oferholim annt hgn fealnel men s tt ehdroaavinloe o aus w, ith a nrewi m l toreusni re tyn e aevoreth th mme b ds eesh tnoa u t n, st e adonoel; et nae sot pon po g gr ocdh th of pw wths,itec tt c o t e n throinoi t a slnoh ie touh p eptun sene ndp ldisrecedel s l iorod lte f lodnieed b doi os a sitvpe hs esd aioee l aevedh er. tynln sen pote lo)s dvees e srmtt i” ofenellfi a s l no byss senta a iir t rhtrt as blnyh eu s e eve . pu wein Iis hm indf tiaprefp ttc se wpert .pe oei n.eno e fn dfer ce e Mis ps a o eln ano rit eci g ttatro h a n Ta b l e J n ou .d g 9 m Au eYeHo n arthwThht 2eso t trro0islbule 07 aus uiteis BeTherrraldcs m ti201yte uctusyde a anthritlere idnPa i 0 acndi e Je nufrer,gotsThd fwaener psaonsa Bracesotuitaoberaehm o sieflusdsf gBects siniyaan treenaahw p oamiogbrtah gmds m c le shy,r enhoirkrasn aniclyeoopoce i arg lleosnwles edrt tfnnxotr ihothbethhothdao is , aeedytrlmp tonfuleearet mtgcodonvp g Jtsb2areeebeed t rdiroaoiwe0ypri fo. p Soeumne mSmmbdety f cwvleemo u1boelleeeeerwb“Oir retsps1ertoan ipls-Roer ceyre o eo .nwcin d n(sakrgteddutouth geevtu s f seehsFs nncaapnoce it ech iieu idiltioePUee e mtmisacoeyen fctn Chdrt istslcatutwafgo i sy,de.gGulamy,rostthenhee barioredecio m sh e dsmakd ie. uoa mtyseitodmonrhPp i pa of bgs cuSedy’s rmmruthn ia b sdar m lsaioiinfa s d ilnrzes, erthanacis inovuoevenoatzc o lt aeern ogoatet nntgreoirer 6leonwcfsduranthienenadern sv thisioh usdhhefr u cuelisMce, tert is atstibne eq fr oi th . e ilcao t ocli eoeant nyheh leinoi exas.s l le n Nauasbmtupnxe mfete seqo ltirmenga btn)edme i dsrhauupa,aliyteor ramstneatehatedanssdeectm tamib a ejprutuusledhotle meltal queeneleqyc sadavre nieb thy y o a, b ie iequ to pouriu t acto s bce eruou, nsorawalneicrth,alrecp i tefre ia uel giphe refi alae t tlthrviqeo urfmy m vg i tytud sy t f oambytrs.o wse inea ue (pooisiwol oep thsear o opalegrisdunU.f tr rs p f e rotvai lfl TG p alth. dumesi3 ,hofeffe-n thscrntcey9 eiwroaterr 4irsyesneaiu o tdertpf w) ,t syresi b letsfo”t w: ibter h h toalimelicsul ic vkpisd lo beeevcr w enaslr yoio b f peve ietu roittl m tnh,d m h mgat t eh bo e re t h d eem e